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ABSTRiiCT 

This aoaogiraph summarizes the development of the 
pupil Observation survey Report (POSB) , an instrument designed to be 
completed by pupils in Junior and senior high school order 

to describe their teachers. The instrument consists of 38 statements 
follow€id by four choice agreement scales. Data from a single class 
a»-e reduced to item means and then to scores on six factor dimensions 
isolated by analysis of over 100 student teachers studied in the 
Mental Health in Teacher Education project at the University of 
Texas, The monograph reviews the various published research studies 
on the development and applications of the Instrument and inclades a 
FORTRAN corapater program for scoring the raw prot^ols, An^example of 
an IBM 1230 optical-scanned answer sheet for the instrument is also 
included. Comparisons of factor structures obtained from analysis of 
data describing large samples of male and female teachers ate 
reported, as well as an extensive series of regression analyses 
concerning various potential inflaences on pupil evaluation of 
teachers. This instrument is currently in use in a number of 
experimental studies being carried out by the S S D Center in Teacher 

Education, (Author) 
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The Pupil Observation Survey 



Teacher Behavior from the Students’ 




Donald J. VeldjTen 



•Robert F- Peck 



T]\a Pupil Observation Survey (POSR) was developed in the 
course of the Mental Health and Teacher Education project at the 



student teaclier behavior. As an alteinative to ratings by trained 
adult observers 5 student evaluations offer the advantages of a much 
more conprehensive sample of observed behaviors and those to be gained 
by averaging over the biases of a large number of judges. The weak- 
nesses of such evaluations are any systematic biases which charaaterize 
the student judges. Among the potential sotjrces of error are the sex 
and social class level of the students 5 as well as their ability to 
render objective and differentiated descriptions of teacher behavior. 
The grade level of the class ^d the subject-matter area are also 
potential sources of systematic differences in the evaluations of 
teachers. 

Previous Research and Development * 



questionnaire originated by Edwin McClain (1961) 5 which was enployed 
as a measure of teacher behavior to be conpared with student-teachers ■ 
self-pex>ceptions (McClain and Bown^ 1961). 

An original set of 45 items was prepared by the authors in 
1961 and administered to a series of public high school classes. Item 



Uiiversity of Texas as one of a variety of criteria describing 



The POSR was outgrowth of research with an experimental 
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analysis of these data resulted in selection of 38 items to neasure 
the following aspects of the teacher’ s ijipact on pupils : 

Identification Model (4 items) 

Interesting Presentations (4 items) 

I-~' lrroness and Respect C 4 items ) 

Systernatic Contixal (4 items) 

Poise and Self-confidence (4 items) 

Friendliness and Interost ( 4 iten® ) 
i hiowledga of Subject ( 4 items ) 
iJemocrat ic Procedure ( 4 items ) 

0}3timism and Cheerfulness (4 items) 

Ge nera.1 Appyr>val (2 items) 

This form was administered to pupils in the classes of 48 
nale and 149 female student teachers during the Spring, 1961, semester. 
In order to determine the influence of sex-role on these pupil eval- 
uations , 34 student teachers of each sex were selected from the larger 
sanple , and their classes were divided into male and female sid^groups 
of pupils. Means were computed for each teacher for each scale se- 
parately from boy and girl data, and the resulting means were conpared 
by analyses of variance. The results were reported elsewhere in detail 
(Veldnmn and. Peck, 1964). In summary, the only interaction effect 
between pupil and teacher sex appeared with the Identification Model 
scale, as expected. ,, 

. During the 1961-1962 academiG year, the POSR was administered 
to almost all classes taught by secondary le%'el (grades 7-12) student ; 
teachers at ithe University. By the j suranrer of 1962, a total of 554 
teachers had' been assessed, and these data (item means) were s^mitted 
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±o ppincipal-axls factor analysis^ followed by varinmx rotation of 
the 5 factors which yielded eigenvalues greater than unity. This 
research is also reported alsewhere in detail (Veldiran Peck 3 1963)* 

The factors emerging from this analysis were tentatively called 
It^iendly, Cfieerful^ Admired 

II . l<howledgeable , Poised 

III. Interest in g , Pr ef erred 

IV. Strict Control 
V , DerMcratic Procedure 

Factor scores were conputed for each of the 554 student 
teacliersj and a vai'^iety of procedures was used to determme the re- 
liability and correlates of these eirpirically derived dhnenslons# 
Separate l^actor analyses of the three semestei'^ subsanples of student 
teacher data yielded almost identical factor structures 3 but when 
factor structures for male and female teachers were conpareds the 
correspondence was less than ideal for two of the five factors. Aid- 
ditional data on this problem will be presented later in this report. 

Fifty of the teachers in the sai^le had separate classes 
during their student-teaching semester 3 and item means and factor 
scores were separately computed for these classes to provide data 
for reliability estimation. The "split-class" correlations calculated 
for the five factor diinnensions were .92 3 *72 3 .SI, .SI, and *89 3 in- 
dicating a satisfactory degree of test-ratest reliability. 

The mean factor scores of rrale and female teachers were 
coJipared by analyses of variance. Fejmle teachers scored significantly 
higher on Factor I ( Friendly, Cheerful 3 Adndred ) on Factor V 
(DeTnocratic Procedure) , Tie factor score v^iables were also correlated 
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with scale scores from two self-report personality inventories ; 
relatively few and low-order relationships ware observed. Ratings 
by University supervisors of student teaching were used as the 
basis for dividing the sarnple into three levels of teaching 
effectiveness ^ and analyses of vari.ajice were coirputed for each POSR 
factor. Factors I ( Friendly ^ Cheerful, Adr^iired ) ^ II ( Knowledgeable ^ 
Poised ) ^ and V C Democratic Procedure ) yielded sl^if leant differences 
for both sexes. All relationships were linear positive 3 with the 
exception of Faotoz*^ I for imles 5 where both the high and low effec- 
tiveness groups had lower ireans than did the average student teachers* 
A considerable amoimt of further research with the POSR 
instruiTient >ias been conpleted since publication of the findings just 
described. Ihe r\ 3 Bults of these studies will be presented later in 
this report. 
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Scoring Proceduires for ■the POSR 

Ihe original vex s ion of the Instrunient was miiiieographed , 
and included the instructions described elsewhere CVeldnan and Peck, 
1963). In order to simplify data-processing , a IBM1230 form has 
been prepared which contains all 38 items and answer spaces on one 
side of the sheet, A copy of the form may be fotjnd on a following 
page of this mamial. No corresponding version for male teachers is 
available at present. These answer sheets may be processed with an 
IBML230 Optical Reader, which will automatically punch an item-data 
card for each protocol. Although the computer program shown on a. . ' , 

following page will not process such cards, it can be adapted to d®i|^o, ‘ 
by methods described in a recent book by Veldman (1967). 




PUPIL OBSERVATION SURVEY (POSR) 

ROBERT F. PECK AND DONAID J VELDMAN 
THE UNIVERSIIV OF TEXAS 



iPENTiFi CATION NU MBER 



STUDENT TEACHER'S NAME 



my AGE __ my SEX (CIRCI U ONE) M E 

MY GRADE 7 0 9 10 II VI 

(CIRCLE ONI!) 
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1. Shu is adinirud by mosl ol her ^.tudunl^, 

2. Slie hoi riiadu lior subjeiT ulive and inlerestirlg for 

' 3. Slic expects a IqI from I s students and usually gets it. 

4. She expiciins her assignments dearly and complefaly. 

- 5. She hardly ever gets flijslerud about anything that happens. 

6. She seems ici under skifid the problems sfudenis have, 

7. She is never sfumpetl by a student's question. 

8. Ikrloit blic decides on ti imw profuct^ she often asks the students what they think 

9. She usually Kis^ks on the 1 Might side of things. 

10- She? is tiu} L)0!it Irrirhei | lujvt? ever had. 

11. I would like to l>i; likn hcM In sorTie ways, 

12, Her doss is nevni dull or boring, 

13» You can tlopf*nd t>ii |u?r frj be fair v/ifh you, 

14* She doesn't let the doss discussion get too for off the subject. 

15. She always seems sure of herself in front of the class, 

16. Yog can tell that she really likes her studenti. 

17. She knows a great deal about her subject, 

18. She never seems to order her students around, 

19. She smiles mo.st of the lime, 

20. I wish oil my teachers were like her. 

21. She sets a good example for her students, 

22. She knowi how to put her subject across in a lively way. 

23. Students respect her because she moons whot she says, 

24. She doesn't try to rover the lesson too fast. 

25. Sh© doesn't seem to be afraief of making mistakes, 

26. She i.s always friendly toward luir students. 

27. She must have studied hord to know so much about her subject, 

28. She likes to give the sluijent a choice of how to do on assignment. 

29. She always seems checuful ond hcippy, 

JO, i would like to have her as a pfvsanat ftiend. 

31. Site mokos leornitiy seem more like fun than woik. 

32. She doDsn't let lior students get away with anything, 

33. She always seems to know just what she'll do next, 

34. She doesn't get confused by unexpected questions, 

35. She is as interested in her students as she is in hor subject, ? ^ 

36. She seems to know more about her subject than just what is in the book. 

37. She is always infereslod in hearing a student's ideas, 

38. She is good-natured and easy to. get along with. 
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If the item data ar« collected with foirms other than that 
for the I_BM123Q machine, the responses shoul.d be transferred to a 
single puiich card according to the following conventions : 

Card ColujTins Content 

1-lQ Identification of teacher (and pupils) 

11-48 Item Scores 

Each item score is deterTnlned as follows; 

T s 1 f = 3 blank or 

t - 2 F ^ M multiple check - 0 

Tlie coding of teacher identification shouJ.d include any 
infoniatjon that nay be useful in later analysis of the teacher 
factor scores wtiich will be conputed by the scoring program — such 
as teaclier sex, grade taught, and subject matter area. Inclusion of 
pupil identification in this field is not necessary; it may be added 
to the end of the card (i.e. , columns 49-80) if desired, 

Conputer Program for Factor Scoring 

On a following page is listed a FOOTR^ IV program which 
accepts class sets of pupil data cards and punches a single card for 
each class set toput to the program. Each class set is terminated by 
a blank card , which initiates the conputation of itCTi means for the 
class and factor scoipes for the teacher concerned* Aiy number of ■ 
class sets may be stacked for a p^^:icular computer nm, and no limit 
is inposed on the class size* A deck of constant-cards precedes idie 
first class set; these cards are listed with the pro^ajn. ^ 

During conputation of item ir^^s for a particular class , 
the program keeps track of the number of valid (non-zero) item scores 
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PROriRAV! POSR 



COMPUTFS AND PUNCHES FACTOR SCORES FOR EACH TEACHER FOR WHOM A DECK 
OF PUPIL CARDS IS ENTERED* 

the program DECK IS FOLLOWED BY A WEIGHT DECK (NEXT PAGE)* AND THEN 
RY ANY NUMBER OF CLASS DECKS. EACH CLASS DECK IS TERMINATED BY A 
BLANK CARD. CLASS DECKS MAY INCLUDE AMY NUMBER OF PUPIL CARDS* 
FORMAT NUMBER 30 MAY BE CHANGED TO ACCOMODATE NON-STANDARD DATA-CARD 
arrangements. USE OF IRM1230 DATA CARDS REQUIRES EXTENSIVE PROGRAM 
MODIFICATION (SEE VFLDMAN* 1957). 

DIMFNSTON A(38)* S(38). W(6»38). T(38)» X(38)* P(3B)* F(6) 

READ 5. A 
READ 5* S 

5 FORMAT (5X» 15F5.A) 

READ 10* W 

10 FORMAT (lOX* 6F5,4. lOX* 6F5,A) 

15 DO 20 I = 1»30 

T ( 1 ) s 0.0 

20 X ( I ) = 0.0 

25 READ 30* IDA. I DP ♦ P 
30 FORMAT (2A5* 38F7.0) 

IF (IDA .FO. IDB) GO TO AO 
DO 35 I s 1*38 

IF (PCI) ,FQe 0.0) GO TO 35 

T(I) = T(I) + i.n 

X(I) = X(I) + 6.0 - P(I) 

35 CONTINUE 
ICX = IDA 
IDY = IDB 
GO TO 25 

40 DO 50 I = 1*38 

IF(X(1).GT.O.O)GOT050 
PRINT 45* I . IDX* IDY 

45 FORMAT < / 5H ITEM* 13* 20H ALL ZERO FOR CLASS * 2A5 ) 

GO TO 15 

50 X(I) = (X(T) / T(I» - Ail)) / S<!) 

DO 55 I - 1*6 
F( I ) ^ 0.0 

DO 55 J a 1*38 

55 F(I) = F(I) + W(ItJ) * XIJ) 

PUNCH 60* IDX* IDY. F 
60 FORMAT (2A5* 6F10.4) 

GO TO 15 
END 








#** WEIGHT DECK *** 
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for each item, and computes the ireans using the appropriate N for each 
item.. Factor 300108 are computed from regression equations based on 
the weights which are listed on pap^e 8. These weights, as well as 
the means and sigmas employed, were derived from analysis of the 
normative sajiple of 562 student teachers which will be reported later 
in this nanual^ Hie factor scores computed by the prograjn are thus 
standardized with regard to this sample — with a mean of zero and 
sigiiia of one. 

Factor Structure of POSR Items 
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Minor improvenonts in the accuracy of computer prograins 
currently available made a re-faotoring of the POSR item-mean data 
desirable. Tlie basic sample was also increased from 554 to 562 
teachers. A principal- axis analysis of the 38-item intercorrelation 
matrix (diagonal unities) again yielded five factors with eigenvalues 
greater than 1.0, whicli together accounted for 78% of the total trace. 
The first principal-axis factor, which accounted for 57% of the trace, 
is of particular interest since it measures the central focus of the 
entire 3 8- item set, and nay be construed as an index of general pupil 
evaluation of the teacher. 

Normalized varimax rotation of the five principal-axis 
factors yielded a structure alntost identical to that reported earlier. 
The loadings of each of the 38 items on each of the varimax factors 
and on the principal axis, as well as the mean and signa for each 
item, are shewn in Table 1. In Table 2 are listed the items which 
loaded each of the. factors most heavily. Hie changes in factor names 
from those reported earlier were as much a function of correlative 
information as of changes in the factor structt.jre itself. . jp 



TARLh 1* MEANS* 



SIGMAS. 



AND factor loadings FOR ALL POSR ITEMS, 



I TFM 


MEAN 


sigma 


Pa 


V-1 


V-2 


V-3 


V-4 


V-5 


1 


3,3034 


.4733 


.9227 


,6704 


,2650 


,5803 


• 1399 


.1199 


2 


3,2107 


,4166 


.8&34 


.3767 


.3336 


,7058 


• 2472 


,2067 


3 


2,9060 


.3181 


.46.15 


.1601 


,2580 


.1017 


• 7559 


• 1015 


A 


3,4730 


.3246 


.7664 


,3249 


,4611 


.5479 


.1751 


• 1201 


5 


3,1107 


,4100 


.6394 


.6416 


,3601 


. 0053 


.2695 


-.0528 


6 


3.2917 


,3668 


.8872 


.7338 


,2749 


.4124 


.1048 


• 1852 


. 7 


2,9400 


,3555 


.4725 


“.0716 


.7415 


, 3846 


• 0705 


-•0697 


8 


2,6929 


,5024 


.5734 


,2801 


,0781 


,3419 


.0632 


.7621 


9 


3,4328 


,3027 


.8283 


.8353 


.1474 


. 2630 


.1550 


.1601 


10 


2,3519 


.5080 


.8429 


.3992 


,2984 


, 7317 


• 1009 


.2009 


11 


2,8735 


,4526 


.87 39 


,5652 


.2637 


,5577 


,2602 


• 1538 


12 


2,9011 


,4556 


.8313 


• 38 16 


• 2801 


• 7239 


.2445 


• 1045 


13 


3,5602 


.2877 


♦ 8 1 8 8 


,7369 


,2891 


• 3228 


-.0014 


.1572 


lA 


3,3461 


,3036 


.3096 


.1743 


,2425 


.0200 


• 5 646 


-•2295 


15 


3,3327 


,3348 


,6645 


.1283 


,6983 


,4061 


,3323 


-.0372 


16 


3,4423 


.3541 


,9023 


.7817 


,2272 


,4238 


,0926 


.1860 


17 


3,6022 


.2363 


.6531 


,2105 


,8505 


, 1698 


.1569 


.1132 


18 


3,1643 


.4201 


.6900 


,8478 


,1747 


,0108 


.0562 


. 1405 


19 


3,5312 


.3021 


,7295 


• 8091 


,0184 


,3127 


,0189 


*0570 


20 


2.8354 


.5545 


,9046 


.5557 


,2780 


.7097 


,0624 


*1325 


21 


3,4211 


,3197 


,9316 


*6444 


• 4070 


,4854 


.2082 


• 1192 


22 


3,2015 


.4131 


.8641 


.3737 


.3650 


.7134 


.2111 


.1748 


23 


3,1084 


.3455 


,7594 


.3341 


,3295 


• 3949 


.6453 


• 2065 


2A 


3,2640 


.3702 


.6703 


.2742 


.2638 


.5792 


,0634 


.2683 


25 


3,4038 


.2426 


.6819 


,3846 


,5149 


. 2366 


,2493 


.1149 


26 


3,5813 


.3312 


,8088 


.9014 


,1530 


.2263 


.0268 


.0731 


27 


3,5549 


,2402 


, 6669 


• 3085 


,7330 


.1166 


.0933 


• 3077 


28 


2.7675 


,3980 


,6669 


.3715 


,1878 


.3907 


-.0261 


.6651 


29 


3,5045 


.3625 


,8115 


,8511 


,0754 


, 3408 


.0706 


.0721 


30 


3.4153 


,3925 


.8727 


.7254 


.2002 


,4661 


.1236 


.1410 


31 


2,9499 


.4674 


,8507 


.4436 


,2205 


,7583 


.1246 


.1632’ 


32 


2.8162 


.3551 


.3101 


-.1196 


.1598 


,2076 


.8492 


.1091 


33 


3.3381 


.2834 


.7014 


.2290 


.6517 


.3446 


.3704 


.0257 


3A 


3.1849 


,3244 


,6854 


,1571 


.7076 


.3798 


.1757 


.0209 


35 


3,3997 


.3149 


.8956 


,7359 


,2455 


,4258 


,1580 


.1883 


36 


3,4401 


.2849 


,6769 


.4010 


,6772 


,0422 


. 1936 


.2530 


37 


3.4493 


• 3180 


,7854 


• 7437 


, 1959 


.1932 


,0491 


.4372 


38 


3,6030 


.3551 


,8567 


.8640 


.1887 


.3452 


.0029 


.0761 




Table 2 . Hems loading each POSR facioip mosi heavily^ 



Pri.nci.pa.1 Axis; feneral IValuation 
21 « She sets a good exanple for her students. 

1. She is admired by jiDSt of her students, 

20, I wish all ny teachere were like her. 

16 . You can tell that she really lnJ<es her students. 

Factor I; liriendly. Cheerful 

26, She is always friendly toward her students. 

38. She is good-natured and easy to get along with. 

29. She always seems cheerful and happy, 

18. Sue never seems to order' ’ jr students around., 

9. She usually looks on the bright side of things. 

Factor II- Hiowledge,^ib.le and Poised 

17. She knows a great deal about her subject, 

34. She doesn’t get confused by unej^ected questions. 

7, She is never stumped by a student’s question. 

27. She must have studied hard to know so much about her subject. 

15. She always seems sure of herself in front of the class. 

Factor III; Lively and Interesting 

31, She makes learning seem more like fun than work. 

10. She is the best teacher 1 ever had. 

12, Her class is never dull or boring, 

22. She knows how to put her subject across in a lively way. 

20. I wish all teachers were like her. 

Factor IV: Finn Control 

32. She doesn't let her students get away with anything. 

3. She ej^ects a lot from her students and usually gets it, 

23, Students respect her because she neans what she says. 

14. She doesn't let the class discussion get too far off the subject. 

Factor V ; Non-Directive 

8. Before she decides on a new project, she often asks the students what 

28. She likes to give the student a choice of how to do an. assignment, 
is always interested in hearing a student's ideas. 
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Wlien the five varimax factor scores were correlated with 
the principal-axis variable, the coefficients obtained were .6695, 
.4282, ,5236, .2242, and .2089. Factors IV ( Finn Control ) and V 
( Non- Diract ive ) are apparently of secondary relevance to the central 
focus of pupil evaluation. 

Comparison of Male and Fennale Factor Structures 

Earlier analyses of seirester subsanples yielded alncst 
identical factor- loading patterns, but when si^sajTples of male and 
female teachers were separately factored, the resulting Btructures 
after vai'’iniax rotation were partially dissimilar. Since the varimax 
criterion is sornewliat arbitrary , and was applied independently to the 
two principal-axis structures , the factor analyses of male and femle 
subsairples were repeated with N=116 and 446 respectively, and the 
resulting varimax structures were conpared by an analytic te<dini.q[ue 
(Veldman, 1967). The matrix of correlations between all coirbinations 
of the male and female factor vectors is shown in Table 3. 

Althou^ Factors I, IV, and V in the two analysas are quite 
sind-lar, Factors II and III shOT considerable mixing across the two 
structures. Since the mtrix in Table 3 is actually that which will 
carry one of the two varimax structures into maximum contiguity with 
tlie other, it is possible to implement this re-rotation of one of the 
structures and then assess the closeness of corresponding item vectors 
from the two structures. Ihe results of this procedure are shewn in 



Table 4. 
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Table 3, 

Correlations Among All l%ie and Female VarimaK-Rotated Factor Vectors 



Feniales ' 
Factors 



I^les ' Factors 



I II III IV V 

I 

II 
III 

IV 

V 



. 89 


-.17 


.41 


-.04 


-.03 


-.18 


. 69 


.69 


.07 


-.10 


-.40 


-.69 


.56 


-.05 


-.21 


.03 


-.09 


-.01 


.99 


-.03 


-.07 


-.09 


.20 


.C3 


.97 



Table 4. 

Similarity of Male and Female Item Vectors after Re-rotation 

of VarimK Factor Structures 



Item 


similarity 


Item 


Similarity 


Item 


SjjTiil .irity 






1 


,99 . 


14 


.95 


27 


.98 






2 


1.00 


15 


.97 


28 


.95 . 






3 


.85 


16 


.99 


29 


.98 


. 




4 


.99 


17 


.99 


30 


.96 






5 


.93 


18 


.86 


31 


.98 






















6 


.98 


19 


.95 


32 


,98 




"S 


7 


.98 


20 


1.00 


33 


,99 






8 


.91 


21 


1.00 


34 


.99 . 






9 


.99 


22 


.99 


35 


.98 






10 


.99 


23 


.98 


36 


,98 






11 


.99 


24 


.94 


37 


, 96 ^ ' 






12 


,99 


25 


.88 


38 








O 

RIC 


.99 


26 


1.00 








■M. 










,1' ■ ■ 


' 7 ' 
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It is obvious from the strengths of the coefficients in 
Table 4 that the nale and female factor structures can be brought 
into alnost perfect alignment. Tlie only POSR iteiris which had coef- 
ficients indicating questionable corr’espondence v;ere : 

3. She (He) ejqDects a lot from her (his) students and usually 
gets it . 

18, She (He) never seems to order her (his) students around. 

25, She (He) doesn’t seem to be afraid of making mistakes. 

'The fact that the male and feinale factor structures can be 
brought into close alignment by appropriate rotation of their principal 
axes supports the factoi’ing of the entire set of male and female pro- 
tocols as a single sample, and the use of the resulting factor variables 
to describe the teaching behavior of members of either sex. ^ 



Some Influences on POSR Scores 



As suggasted earlier in this report , both pupil and teacher 
characteristics nsay be expected to influence the pupil evaluations , 
and hence the POSR factor scores. Analysis of some early POSR data 
indicated , for instance , that there were no important interactions 
between pupil and teacher sex which might bias pupils ' evaluations of 
teacher behavior , although boys and girls did differ to some extent 
in their tendencies to rate teachers high or low on particular factors. 
Because pupil sex was not recorded in later data-processing procedimreSj 
this source of variation could not be included in the present analysis. 



Five potentially significant types of information were included 



O 

me 



in the present design; V " ■ - 

(a) the grade obtadned by the student teacher from her University . \ 

supervisor* which constitutes a rough estimiate of the quality, 



;:A 



of her teaching performance in termB of the standards of 
fessional educators. 
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(b) the grade levelCs) taught by the student teacher. Some 
classes contained pupils from a variety of grade levels 
between 7 and 12, while others were restricted to a single 
grade level . 

(c) the subject'-inatter area taught by the student teacher. 

Seven subject-niatter categories were defined for this 
analysis. 

(d) the social class level of the school concerned. Rather than 

identify each of the 33 schools in which POSR data were ob- 
tained, the schools were classified with regard to what 
woiild seem to be an inporfant characteristic: the socio- 

econoniic level of the district served by the school. 



(e) the sex of the student teacher. Previous analysis indicated 
that teacher sex was a significant source of variation for 
Factors I ( Friendly and Cheerful ) and V ( Non-Directive ) . 

This variable was included in the present design in order 
to determine more precisely its influence in the presence of 
the other determinants. 

The technique used to study these influences is known generaD.ly 
as regression analysis of covariance. Each of the six POSR factors in 
turn was used as the criterion to be predicted from the five kinds of 



inforTnation just described. Equations were established for each of 
the criteria using all five sources , and then additional equations were 
established which enployed only four of the five sources, leaving each 
source in turn out of the predictor set. By conparing the predictive 
efficiency of the full predictor set with those of each of the five 
restricted predictor sets for a particular POSR factor criterion, it 



was . possible to determine the inportance of each type of predictor in- 
formation in terms of the amount of criterion ■ variance it axplained 



^ jeyond that explained by the other four sources. 

hHJC 
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In addition to deterniining the importance of each of the 
five kinds of information concerned, this technique also permitted 
the computation of expected criterion values (POSR factor scores) for 



hypothetical teachers who were alike in all but one of the five re- 
spects concerned, , For 'instance, it was possible to datermdne the 
score to be expected on POSR Factor I for a male and for a female 
teachei'' who obtained the same student-teaching grade and taught the 
sajite grade the sariE subject-matter in schools of the same socioeconomic 
level -- averi tlioiigh two sucli teachers ndglit not have appeared in the 
sanple , 

nie r’c;"3ults of these regression analyses are suimiarized in 
the following paragraphs, which describe the influence of each type 
of information upon the six POSR factor criteria. Althou^ data were 
available for a total of 609 student teachers, the N concerried in 
assessing the iirpact of soto sources was lowered because of missing 

data or because of the nature of the categories used, 

I 

Grade Obtained in Student Teaching Course 



Ejqpected Criterion Scores 



Grade 


N 


Principal 

Axis 


Friendly , 
Cheerful 


Hiowledgeable , 
Poised 


Livelv, 

Interesting 


Firm 

Control 


Non- 

Directive 


A 


216 


.2874 


.1563 


.2645 


.0851 


,0980 


.0145 


A-, B+ 


107 


.2302 


.0514 


.1266 


.1735 


.1226 


.1306 


B 


210 


-.2277 


-.0327 


-.1724 


-.1631 


-.1499 


-.0822 


B- and below 


75 




-.5829 


-.2837 


-.3915 


-.2276 


-,2571 


-,1807. 


% variation ejgslained 8.96 


1.83 


4.78 


2.04. 


1,99 . . 


t .83 , , 


chance probability 


<.00005 


.0086 


<.00005 


.0032 


.0096 


-:;.2026 , 
mV . 



O 
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Inspection of this table reveals quite cleaz-’ly that the 
pupils and the student-teaching supervisors agree to a significant 
extent regarding tl-ia general raffectiveness of the student teachers. 
SignificaJit relationships also appear for all of the rotated POSR 
factors except V ( Non-Directive ) . The relationships are definitely 
linear with the principal axis and the first two rotated factors, 
but the other three factors show a conroon curvilinear oonponent at 
the highest grade level. Apparently, very high grades do not cor- 
respond to very high scores for liveliness, control, or non-directive- 
ness. In tei'nia c^f explained variance, student-teadiing gradas appef.r 
to be riDst re.Levdint to the principal axis ( General Evaluation ) and to 
Factor ' 1 .1. ( Kt low.l (crigeable , Poised) . 



Grade Level of the Clans 'T'mipht 

^ - ■ ; ; _ : t..j 



Expected Criterion Scores 



Grade 


N* 


Principal 

Axis 


Friendly , 
Clieerful 


iQiowledgeable , 
Poised 


Lively , 
Interesting 


Firwi 

Control 


Non- 

Directive 


7th 


136 


-.0251 


-.4820 


.1021 


.3989 


.0714 


.1394 


ath 


139 


-.0365 


-.1330 


.1543 


.0769 


-.0794 


-.2120 


9 th 


178 


-.1549 


-.1670 


.0709 


-.1074 


-.0648 


-.0553 


10th 


169 


.1380 


.2859 


-.0568 


-.0416 


-.1123 


.0609 


11th 


138 


.0313 


.3340 


-.1298 


-.3217 


.0762 


.0325 


12th 


88 


.0908 


.6155 


-.3242 


-.2659 


.0342 


-.2002 


variation explained 


.78 


7.38 


1. 55 


3,44 


.41 


.99 


ance probability 


.5035 


<■.00005 


.1277 


' ,0003 


.8394 


.3160 



-’s greater than 609 because the 6 categories are not mutually exclusive. « .. 

ERIC "'y-:- ; / . X 18 
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Only two of the six factors were significantly related to 
grade-level infonration. In general, senior high E^chool students 
appear to consider their student teachers to be moi’e friendly and 
cheerful than do junior high students — particularly seventh graders. 
Hie trend for Factor III is alnost reversed, with the higher grade 
levels rating their teachers lower in this regard. 

One is teiipted to speculate about the seventh graders, con- 
sidering their recent change from the quite different elementary school 
gnvironiisnt | their evaluations may rsflsct reactic j to tliis change , 
to some extent. They saw their student teachers as relatively less 
friendly and cheerful, but more lively, interesting, and non-directive. 

Another interesting break appears between the 9tli and 10th 
grades on tlie first rotated factor. There is a distinct shift in 
attitude at this academic transition point, but the ijnplications of 
this fact are not at all clear. 



aubject Fitter Taught to Class 



Ej^ected Criterion Scores 



Subject 


N 


Principal 

Axis 


Ihiendly , 
Cheerful 


l^owledgeable , 
Poised 


Lively, 

Interesting 


Fim 

Control 


Non- 

Directive 


Social Sciences 


121 


-.0154 


-.0706 


.1510 


-.1794 


-.1471 


.5147 


English 


157 


,0514 


.1418 


.0329 


-.0597 


-.2477 


.1192 


Fine Arts 


70 


-.1741 


-.4226 


.3229 


.0222 


-.1342 


-.1090 


Hone Ec. , Business 


05 


. 1665 


-.0459 


-.2017 


.3834 


.2607 


.1757 


Foreigti Language 


30 


-.2165 


.2858 


.0077 


-.6068 


.1378 


-.6665 


Mkth - Science 


94 


-.2741 


.2880 


-.1864 


-.4901 


-.1750. 


-.4613 


Physical Education 


52 


.3765 


-.0758 


-.1278 


' ,9o: ■: 


.7665 


-.7495 • 


% variation ei^lained 


3.20 


3.53 


1.92 


14,16 


7.91 


13.29 ' V 


O 


.0033 


,0007 


.0909 


<.00005 


<.00005 


■ <,00005 
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As might be expected, Factors III ( Lively , Interesting ) and 
V ( Non-Directive ) were strongly affected by the subject-rratter area 
of the class in which the POSR was administered. Although there is 
no way to separate the two aspects of this influence, much of the ef- 
fect is probably due to the nature of the class , as opposed to the 
nature of the teacher concerned. 

Physical Education was evaluated highest. The scores were 
very high for liveliness and interest, firm control, and directiveness. 

Hone Economics and Business was also evaluated hi^ly- It 
was seen as lively aiid interesting, firmly controlled, and non-directive, 
but not very knowledgeable or poised. 

English was evaluated at an average level. The ratings 
suggested weak control, more than average friendliness, and less than 
average directiveness. 

Social Science was evaluated at an average level. Non- 
directiveness was the defining characteristic, but liveliness and 
control were rated quite low, while knowledge was rated high. 

Fine Arts was evaluated considerably below average. Knowledge 
and poise were considered very high, but SQores on friendliness were 
very low. Control was rated below average also. 

Foreign Language was evaluated quite low. Directiveness and 

ct ■ „ , 

lack of livelinl^hs and interest were characteristic, although friendliness 
and controJ- were mted above average . 

Math and Science received the lowest evaluation, Althou^ 
friendliness was rated quite high, liveliness and interest were rated 
very low, directiveness was strong, and kncwledge, poise, and control 
were rated below average. 
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These results indicate that POSR evaluations of single 
teachers cannot be coripared safely to nonrative values wMch do not 
differentiate arrong. subject-matter areas. Expected values for physical 
education teachers , for instance , are almost a full standard deviation 
above the general average on Factor III ( Lively and Interesting ) — a 
deviation which almost certainly reflects the character of the subject 
matter rather than the teachers concerned. 



Socioeconomic Level of the School 



Expected Criterion Scores 



Socioeconomic 

Level 


N 


Principal 

Axis 


Friendly , 
Cheerful 


Knowledgeable , 
Poised 


Li\rely , 
Interesting 


Firm 

Control 


Non- 

Directive 


1 (low) 


99 


.2224 


-.0087 


.1501 


.4898 


-.3858 


.0202 


2 


133 


-.0314 


-.1050 


-.0243 


.0300 


.0261 


.1678 


3 


113 


.0055 


.0608 


.0484 


-.0767 


.0966 


-.1406 


4 


91 


0898 


-.0955 


.0439 


-.0964 


.0955 


-.0444 


5 (high) 


137 


-.0814 


.2208 


-.0646 


-.2957 


-.0213 


-.2023 


% variation 
ej^lained 


1.22 


1.28 


.82 


6.01 


2.52 


2.11 


chance 

probability 


.1383 


.0858 


.3840 


<.00005 


,0050 


. 0104 



O 
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ttily Factor III ( Lively and Interest hig ) appear'ed to be 
influenced markedly by this source of variation. The lowest socio- 
economic group rated their teadiers hipest on this dimension} while 
the highest level. ^?oup rated their teachers quite low. The lowest 
group also rated their teachers low on Firm Control } but the other 
groups did not deviate much from the general average. The same effect 



■■W 






I ■ 
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appeared with the principal axis ( General Evaluation ) and with 
l^'iowledffeable , Poised , where the lowest-level group rated their 



teacher's considerably higher than did the other giroups. 



Sex of the Teacher 



Expected Criterion Scores 



Sex 


N 


Principal 

Axis 


Friendl y , 
Cheerful 


Knt^ledgeable j 
Poised 


Lively ^ 
Interesting 


Firm 

Control 


Non- 

Directive 


Males 


116 


-.1810 


-.2698 


.0082 


.0048 


-.1364 


.0773 


Fenmles 


493 


.0334 


. 0368 


.0082 


-.0302 


-.0011 


-.0461 


' variation explained 


,S6 


1. 51 


.00 


.02 


.23 


.20 


hance probability 


. 0467 


. 0012 


1.0000 


.7047 


.2116 


.2258 



the only iirportant influence of teacher sex appeared with 
Factor I ( Friendly , Cheerful ) , where feinales obtained hi^er ratings 
thair did males. The previously-mentioned finding of a sex difference 
on Factor V ( Non-Directive ) did not hold up in the present analysis 
where the effects of the other sources were held constant statistically. 



Summary of Effects on Each Factor 

Factor I ( i-'t'iendly and Cheerful ) was influenced priniarily 
by the grade level of the students taught (7%). A total of 23% of 
the variance of this factor was accounted for by the five sources 
included in the desi^i. 

Factor II ( Knowledgeable aid Poised ) was mfluenced strongly 
by teacher alsility (grades) (5%), A total of only 9% of the variance 
of this factor was accounted for by all sources. 




r s2 
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Factor III ( Lively and Interesting ) was very heavily in-- 
tTuenced by the subject^-inatter area (14%) and was also a function 
of the socioeconomic levels of the schools (6%)^ A total of 27% of 
the variance of this factor was explained* 

Factor IV ( Firm Control ) was irost strongly influenced by 
the subject-matter area (7%). A total of 14% of the variance was 
e:xplained by all sources* 

Factor V ( Non- Directive ) was very much influenced by the 
subject-iratter area (13%)* A total of 19% of the variance was ex-- 
plained. 

The prjricipal axis ( General Evaluation ) was most strongly 
influenced by toachcr ability (9%). A total of 15% of the variance 
was accoimted for by all sources together t. 
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Discussion 

The results contained in this monograph indicate that 
pupils' observation reports of student teacher behavior can provide 
reliable and valid indices for use in research applications which 
conpare groups. The findings also suggest that the interpretation of 
POSR profiles for individual teachers must be approached with con- 
siderable caution due to significant variation in expectations OTiong 
subject-matter areas and pupil social-class levels. 

Because no evaluation of observed behavior can be separated 
entirely from the nature of the situation and of the task being per- 
formed diiring the obBervation^ nor from the character of the observer. 



himself 5 data obtained by this or any other observational teclmiqua will 



inevitably be more difficult to interpret on a normative basis than wil; 



T 
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indices obtained from self reports or from ar'tificially controlled 
perfonnance tests. However, it would be erroneous to conclude from 
the results of the regression analysis that pupil evaluations cannot 
be relied upon as measures of teacher behavior. In the first place, 
soii^ of the "extemal” ' influences concerned are undoubtedly neasur'ing 
both teacher' and situational variables. For example, some of the 
explanatory powe;r of the subject-matter fields is undoubtedly due to 
systematic differences in the kinds of teachers who select these fields, 
as well as the impact of the subject-matter itself upon the pupils' 
evaluations. ThfS same mixing of effects is probably true of the grade- 
level variat^le. Despite the fact that particular' influences had de- 
irionstrabie elfects on the pupil evaluations, relatively little of the 
variation among teachers was explained by the sources measured. Ihere 
is a great deal of variation here which needs to be identified In . 
further resear’ch. Tlie most obvious potential sources ai'e teacher 
personality, attitude, and phyalcal appearance. 

Unlike ratings of observed behavior by adult judges, pupil 



O 
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evaluations have the advantage of averaging a large number of individual 
biases. They are also the product of observing the teacher on many 
occasions under' "normal" conditions , and hence avoid irany of the ob- 
vious pTOblems encounter'ed in typical "one-shot" classroom observations. 
With the availability of automated data-processing procedures , it would 
appear that the use of pupil evaluations as one facet of a comprehensive 
assessment batter’y for teaclrers is very much warranted. Pupil evaluations 
should not be considered apart from other indices , any more than self- 
reports should be used as the sole basis for estimating a teacher's 
characteristics and potential. They do provide important information, 
however — from a unique viewpoint. 
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